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On the Nonexistence of Quadratic Lyapunov 
Functions for Consensus Algorithms 
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Abstract 

We provide an example proving that there exists no quadratic Lyapunov function for a certain class 
of linear agreement/consensus algorithms, a fact that had been numerically verified in [6]. We also 
briefly discuss sufficient conditions for the existence of such a Lyapunov function. 

1. Introduction 



CN ■ We examine a class of algorithms that can be used by a group of agents (e.g., UAVs, nodes of 

^ . a communication network, etc.) in order to reach consensus on a common opinion (represented 

00 
(N 

\0 ■ severe restrictions on inter-agent communications. 
O 

, We focus on a particular algorithm, whereby, at each time step, every agent averages its 



by a scalar or vector), starting from different initial opinions, and possibly in the presence of 



own opinion with received messages containing the current opinions of some other agents. 



^ ! While this algorithm is known to converge under mild conditions, convergence proofs usually 
I rely on the "span norm" of the vector of opinions. In this note, we address the question of 
whether convergence can also be established using a quadratic Lyapunov function. Among 
other reasons, this question is of interest because of its potential implications on convergence 
time analysis. A negative answer to this question was provided in [6], where the nonexistence 
of a quadratic Lyapunov function was verified numerically. In this paper, we provide an explicit 
example and proof of this fact. 
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In Section II we give some definitions and formally state the problem. Section III contains 
the main result and its proof. Section IV provides some additional perspective, together with 
some conditions under which a quadratic Lyapunov function is guaranteed to exist. 

II. The Agreement Algorithm 

We consider a set = {1,2, ... ,n} of agents embedded, at each nonnegative integer time 
t, in a directed graph G{t) = {N, £{t)). We assume that G £{t), for all i and t. We define 
Ni(t) = {j I G S{t)}, and let di{t) be the cardinality of iVi(t). 

Each agent i starts with a scalar value Xi{0). At each time t, agent i receives from every 
agent j G Ni{t) a message with the value of Xj{t), and uses the received values to perform 
the update 

n 

Xi{t + 1) = ^ay(t)xj(t), 

where the aij{t) are nonnegative coefficients that satisfy aij{t) = if ^ and 

Y.jeNi{t) (^iji't) = so that Xi{t + 1) is a weighted average of the values Xj{t) held by the 
agents at time t. We define the vector x{t) = {xi{t), . . . ,Xn{t)), and note that the algorithm 
can be written in the form x{t + 1) = A{t)x{t). 

We next state some conditions under which the agreement algorithm is guaranteed to con- 
verge. 

Assumption 1: There exists some a > such that if G £{t), then aij{t) > a. 

Assumption 2: (Bounded intercommunication intervals) There is some B such that for every 
nonnegative integer k, the graph {N,£{kB) U £{kB + 1) U ■ ■ ■ U £{{k + l)B)) is strongly 
connected. 

Theorem 3: Under Assumptions 1-2, and for every a;(0), the components Xi{t), i = 1, . . . ,n, 
converge to a common limit. 

Theorem [3] is presented in [11] and is proved in [10] (under a slightly different version 
of Assumption 2), as well as in [6], for a special case to be considered below; see also [5], 
[9] for generalizations and extensions. On the other hand, if the graphs G{t) are symmetric, 
namely, G £{t) if and only if G £{t). Assumption 2 can be replaced by the weaker 
requirement that the graph {N,Lis>t£{t)) is strongly connected for every t > 0; see [5], [7], 
[4], [9]. 
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We will focus on a special case, motivated from the model of Vicsek et al. [12], and studied 
in [6], to be referred to as the symmetric, equal-neighbor, model. In this model, the graphs 
G{t) are symmetric, and aij{t) = \/di{t), for every (j, i) G S{t). Thus, each node i forms an 
unweighted average of the values Xj{t) that it has access to (including its own). 

Theorem 1 is usually proved by showing that the "span norm" maxjXi(t) — mi\iiXi{t) is 
guaranteed to decrease after a certain number of iterations. Unfortunately, this proof method 
usually gives an overly conservative bound on the convergence time of the algorithm. Tighter 
bounds on the convergence time would have to rely on alternative Lyapunov functions, such 
as quadratic ones, of the form x^Mx, if they exist. 

Although quadratic Lyapunov functions can always be found for linear systems, they may 
fail to exist when the system is allowed to switch between a fixed number of linear modes. 
On the other hand, there are classes of such switched linear systems that do admit quadratic 
Lyapunov functions. See [8] for a broad overview of the literature on this subject. For the 
symmetric, equal-neighbor model this issue was investigated in [6]. The authors write: 
"...no such common Lyapunov matrix M exists. While we have not been able to 
construct a simple analytical example which demonstrates this, we have been able to 
determine, for example, that no common quadratic Lyapunov function exists for the 
class of all [graphs which have] 10 vertices and are connected. One can verify that 
this is so by using semidefinite programming..." 
The main contribution of this note is to provide an analytical example that proves this fact. 

in. The Example 

Let us fix a positive integer n. We start by defining a class Q of functions with some 
minimal desired properties of quadratic Lyapunov functions. Let e be the vector in 3?" with 
all components equal to 1. A square matrix is said to be stochastic if it is nonnegative and 
the sum of the entries in each row is equal to one. Let A C 3?"^" be the set of stochastic 
matrices A such that: (i) an > 0, for all i; (ii) all positive entries on any given row of A 
are equal; (iii) > if and only if aji > 0; (iv) the graph associated with the set of edges 
I aij > 0} is connected. These are precisely the matrices that correspond to a single 
iteration of the equal-neighbor algorithm on symmetric, connected graphs. 
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Definition 4: A function Q : 3?" — ^ 3? belongs to the class Q if it is of the form Q{x) = 
Mx, where: 

(a) The matrix M E 3?"^" is nonzero, symmetric, and nonnegative definite. 

(b) For every A e A, and x e 3?", we have Q{Ax) < Q{x). 

(c) We have Q{e) = 0. 

Note that condition (b) may be rewritten in matrix form as 

x'^A'^MAx < x^Mx, for all A e A, and x e 3?''. (III.l) 

The rationale behind condition (c) is as follows. Let S be the subspace spanned by the vector 
e. Since we are interested in convergence to the set S, and every element of S* is a fixed point 
of the algorithm, it is natural to require that Q(e) = 0, or, equivalently. 

Me = 0. 

Of course, for a Lyapunov function to be useful, additional properties would be desirable. For 
example we should require some additional condition that guarantees that Q(x{t)) eventually 
decreases. However, according to Theorem [51 even the minimal requirements in Definition |4] 
are sufficient to preclude the existence of a quadratic Lyapunov function. 

Theorem 5: Suppose that n > 8. Then, the class Q (cf. Definition |4]) is empty. 

The idea of the proof is as follows. Using the fact the dynamics of the system are essentially 
the same when we rename the components, we show that if x^Mx has the desired properties, 
so does x^Zx for a matrix Z that has certain permutation-invariance properties. This leads us 
to the conclusion that there is essentially a single candidate Lyapunov function, for which a 
counterexample is easy to develop. 

Recall that a permutation of n elements is a bijective mapping a : {1, . . . , n} — ^ {1, . . . , n}. 
Let S be the set of all permutations of n elements. For any (j G S, we define a corresponding 
permutation matrix by letting the ith component of Pa-x be equal to Xo-(i)- Note that P^^ = 
Pj, for all cr G S. Let V be the set of all permutation matrices corresponding to permutations 
in S. 

Lemma 6: Let M E Q. Define Z as 

Z = J2 P^MP. 
Per 
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Then, Z e Q. 

Proof: For every matrix A E A, and any P E V, it is easily seen that PAP^ E A. This is 
because the transformation A i— PAP^ amounts to permuting the rows and columns of A, 
which is the same as permuting (renaming) the nodes of the graph. 

We claim that if M E Q and P G then P'^MP E Q. Indeed, if M is nonzero, 
symmetric, and nonnegative definite, so is P^MP. Furthermore, since Pe = e, if Afe = 0, 
then P^MPe = 0. To establish condition (b) in Definition IH let us introduce the notation 
Qp{x) = x^{P^MP)x. Fix a vector x E 3?", and A E A; define B = PAP'^ E A. We have 

Qp{Ax) = x^A^P^MPAx 

= x'^P^PA'^P^MPAP'^Px 

= x^P'^B'^MBPx 

< x'^P^MPx 

= Qp{x), 

where the inequality follows by applying Eq. (IIII.ll) . which is satisfied by M, to the vector Px 
and the matrix B. We conclude that Qp E Q. 

Since the sum of matrices in Q remains in Q, it follows that Z = J2pep P^MP belongs to 

Q.m 

We define the "sample variance" V{x) of the values xi, . . . , x^, by 

n 

vix) = Y.ix,-xY, 

i=l 

where x = (l/n) J2i=i ^i- This is a nonnegative quadratic function of x, and therefore, V{x) = 
x^Cx, for a suitable nonnegative definite, nonzero symmetric matrix C E 3?"^". 
Lemma 7: There exists some a > such that 

x'^Zx = aV{x), for all X e 3?". 
Proof: We observe that the matrix Z satisfies 

R^ZR = Z, for all ReV. (111.2) 
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To see this, fix R and notice that the mapping P ^-^ PR is a bijection of V onto itself, and 
therefore, 

R^ZR = {PRfM{PR) = ^ P^MP = Z. 

PeV PeV 

We will now show that condition (IIII.2I) determines Z, up to a multiplicative factor. Let Zij 
be the j)th entry of Z. Let e^*' be the zth unit vector, so that e^'^^Ze^^^ = zu. Let PeV 
be a permutation matrix that satisfies Pe^^'> = e^^\ Then, za = e'^^^^Ze^*) = e^^'>'^ P'^ZPe^^'> = 
e^^^'^Ze^^^ = Zjj. Therefore, all diagonal entries of Z have a common value, to be denoted by 
z. 

Let us now fix three distinct indices k, and let y = e*^*) +6^-'^ w = e^*) + e^''\ Let P E V 
be a permutation matrix such that Pe*^'^ = e^*) and Pe^^^ = e(^\ so that Py = w. We have 

2z + 2zij = y^Zy = y^P^ZPy = w'^Zw = 2z + 2zik. 

By repeating this argument for different choices of k, it follows that all off-diagonal entries 
of Z have a common value to be denoted by r. Using also the property that Ze = 0, we obtain 
that z+{n—l)r = 0. This shows that the matrix Z is uniquely determined, up to a multiplicative 
factor. 

We now observe that permuting the components of a vector x does not change the value of 
V{x). Therefore, V{x) = V{Px) for every P E V, which implies that x^P^CPx = x^Cx, 
for all P G P and x E Thus, C satisfies (IIII.2I) . Since all matrices that satisfy (IIII.2I) are 
scalar multiples of each other, the desired result follows. ■ 

Proof of Theorem |5l In view of Lemmas [6] and |71 if Q is nonempty, then V E Q. Thus, it 
suffices to show that V ^ Q. Suppose that > 8, and consider the vector x with components 
xi = X2 = x^ = Xi = 2, x^ = 0, = X7 = —3, xs = —5, and xg = ■ ■ ■ = a;„ = 0. We 
then have V{x) = 80. Consider the outcome of one iteration of the symmetric, equal-neighbor 
algorithm, if the graph has the form shown in Figure [B After the iteration, we obtain the vector 
y with components yi = 11/5, ?/2 = = = 7/2, j/g = 0, j/e = 2/7 = -4, j/s = -11/4, and 
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Xg "3 Xy "3 




Fig. 1. A connected graph on n nodes showing that V{x) is not a Lyapunov function when n > 8. All arcs of the form 
(i, i) are also assumed to be present, but are not shown. The nodes perform an iteration of the symmetric, equal-neighbor 
model according to this graph. 



?/9 = ■ ■ ■ = Z/n = 0. We have 

n 

Vn{y) = Y.im-yf 

i=l 
i=l 

> i:{y^-lT.y^)\ (ni-3) 

i=i ^ ^ i=i 

where we used that I]i=i(yi ~ -2)^ is minimized when z = (l/k) Y.i=i Vi- A simple calculation 
shows that the expression (IIII.3I) evaluates to 10246/127 ~ 80.68, which implies that V{y) > 
V{x). Thus, if n > 8, V ^ Q, and the set Q is empty. ■ 

IV. Conditions for the Existence of a Quadratic Lyapunov Function 

Are there some additional conditions (e.g., restricting the matrices A to a set smaller than 
A), under which a quadratic Lyapunov function is guaranteed to exist? We start by showing 
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that the answer is positive for the case of a fixed matrix (that is, if the graph G(t) is the same 
for all t). 

Let A be a stochastic matrix, and suppose that there exists a positive vector vr such that 
tt'^A = 7r^. Without loss of generality, we can assume that Tr^e = 1. It is known that in this 
case, 

x'^A^DAx < x'^Dx, V X e 3?", (IV.4) 

where D is a diagonal matrix, whose ith diagonal entry is equal to tt^ (cf. Lemma 6.4 in [2]). 
However, x^Dx cannot be used as a Lyapunov function because De ^ (cf. condition (c) in 
Definition |4l). To remedy this, we argue as in [3] and define the matrix H = I — evr^, and 
consider the choice M = H^DH. Note that M has rank n — 1. 

We have He = (/ — e7r-^)e = e — e(7r^e) = e — e = 0, as desired. Furthermore, 

HA = A- en'^A = A - en'^ = A - Aen'^ = AH. 

Using this property, we obtain, for every x E 3?", 

x'^A^MAx = x^A^H^DHAx = {x^ H^)A^ DA{Hx) < x^H'^DHx = x'^Mx, 

where the inequality was obtained from (IIV.4I) . applied to Hx. This shows that H^DH has 
the desired properties (a)-(c) of Definition IH provided that A is replaced with {A}. 

We have just shown that every stochastic matrix (with a positive left eigenvector associated 
to the eigenvalue 1) is guaranteed to admit a quadratic Lyapunov function, in the sense of 
Definition m Moreover, our discussion implies that there are some classes of stochastic matrices 
B for which the same Lyapunov function can be used for all matrices in the class. 

(a) Let B he a set of stochastic matrices. Suppose that there exists a positive vector tt such 
that TT^e = 1, and tt'^A = vr^ for all A E B. Then, there exists a nonzero, symmetric, 
nonnegative definite matrix M, of rank n—1, such that Me = 0, and x'^A^MAx < x'^Mx, 
for all X and A E B. 

(b) The condition in (a) above is automatically true if all the matrices in B are doubly stochastic 
(recall that a matrix A is doubly stochastic if both A and are stochastic); in that case, 
we can take tt = e. 
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(c) The condition in (a) above holds if and only if there exists a positive vector tt, such 
that Ti'^Ax = vr^x, for all A E B and all x. In words, there must be a positive linear 
functional of the agents' opinions which is conserved at each iteration. For the case of 
doubly stochastic matrices, this linear functional is any positive multiple of the sum J27=i 
of the agents' values (e.g., the average of these values). 
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